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DETAILED ACTION 

This is a first office action in response to application 10/540,526 filed on 
6/24/2005 in which claims 1-18 are presented for examination. 

Information Disclosure Statement 

The information disclosure statement filed on 6/24/2005 is in compliance with the 
provisions of 37 CFR 1 .97. Accordingly, the information disclosure statements are 
being considered by the examiner. 

Priority 

Receipt is acknowledged of papers submitted under 35 U.S.C. 1 19(a)-(d), which 
papers have been placed of record in the file. 

Claim Rejections - 35 USC § 101 
35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

Claims 9-13 are rejected under 35 U.S.C. 101 because the claimed invention 
is directed to non-statutory subject matter. 
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Claims 9-13 disclose "A storage medium for a program that cause a computer to 
execute control...". MPEP 2106 states "Since a computer program is merely a set of 
instructions capable of being executed by a computer, the computer program itself is 
not a process and a claim for a computer program, without the computer-readable 
medium needed to realize the computer program's functionality, should be treated as 
nonstatutory functional descriptive material". Claims 9-13 do not claim the computer- 
readable medium needed to realize the computer program's functionality. 

Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

Claims 1-8 and 14-18 are rejected under 35 U.S.C. 102(b) as being 
anticipated by Kanade et al. US 2003/0076413. 

Re claim 1 , Kanade discloses a multi perspective video capture system (10) that 
acquires video information of a target object from multiple perspectives, comprising: a 
plurality of cameras (16 a -i, 42) that are movable in three dimensions and which are 
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capable of following the movement of a target object (page 2, paragraph 24, page 4, 
paragraphs 45-46), wherein video image data of a moving image is synchronized for 
each frame of the plurality of cameras (16 a -i, 42), camera parameters for each frame of 
each of the cameras, and association information (time stamps of image frames) that 
mutually associates the video image data of the moving image with the camera 
parameters for each frame are acquired, and video image data of the moving image of 
the plurality of cameras (16 a -i, 42) is calibrated for each frame by using camera 
parameters (zoom control parameters and viewing angle parameters) that are 
associated with the association information, and information for analyzing the three- 
dimensional movement and attitude at each point in time of the target object is 
continuously obtained (page 2, paragraph 24— page 4, paragraph 43). 

Re claim 2, Kanade states that the output of the cameras (16 a -\, 42) may be 
digitally stored on a continuous basis in the respective video storage units (20 1-n) and 
the timing of each video frame may be time-stamped with each video frame (page 2, 
paragraphs 24 and 27). In addition, Kanade states that the inter-image capturing device 
calibration device (36) stores data (such as zoom control parameters and viewing angle 
parameters) on the relationship between each image capturing device (14) to the scene 
and other image capturing devices (page 3, paragraphs 35-36). Therefore, it can be 
seen that Kanade discloses storing video image data and camera parameters for each 
frame. 
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Re claim 3, Kanade discloses a multi perspective video capture system (10) that 
acquires picture information of a target object from multiple perspectives, comprising: a 
plurality of cameras (16 a -i, 42) that are movable in three dimensions for acquiring video 
image data of a moving image (page 2, paragraph 24, page 4, paragraphs 45-46); a 
detector (control unit 24) for acquiring camera parameters of each camera (page 3, 
paragraphs 31 and 35-37); a synchronizer (image sequencing module) for 
synchronizing the plurality of cameras (16 a -i, 42) (page 2, paragraph 24; page 4, 
paragraph 42); a data appending device (inter-image capturing device calibration 
database 36) for adding association information that makes associations between 
synchronized moving image video image data of each camera (16 a -i, 42) and between 
moving image video image data and camera parameters (zoom control parameters and 
viewing angle parameters) (page 3, paragraph 32-page 4, paragraph 46); and a 
calibrator (image generators 20) for calibrating the video image data of each moving 
image by means of corresponding camera parameters on the basis of the association 
information and for obtaining information for analyzing the movement and attitude of the 
target object (page 4, paragraphs 42-43). 

Re claim 4, Kanade further discloses a video image data storage (22 i. n ) for 
storing, for each frame, video image data to which the association information (video 
frames are time-stamped) has been added (page 2, paragraphs 24-27); and a camera 
parameter storage (inter-image capturing device calibration database 36) for storing 
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camera parameters (zoom control parameters and viewing angle parameters) to which 
the association information has been added (page 3, paragraphs 35-36). 

Re claim 5, Kanade further discloses that the association information (video 
frames are time-stamped) is a frame count of video image data of a moving image that 
is acquired from one camera of the plurality of cameras (16 a -i, 42) (page 2, paragraph 
24). The Examiner is reading the labeling of the timing of each video frame (time- 
stamping) as including a frame count as association information. 

Re claim 6, Kanade further discloses that the camera parameters include camera 
attitude information of camera pan and tilt (viewing angle parameters) and zoom 
information (zoom control parameters) (page 4, paragraphs 45-46 and page 3, 
paragraphs 35-36). 

Re claim 7, Kanade discloses that the camera parameters include viewing angle 
parameters in x, y and z coordinates (page 3, paragraph 36). Thus, it can be seen that 
Kanada discloses that the camera parameters include two dimensional or three- 
dimensional position information of the camera. 

Re claim 8, Kanade states that the video frames captured by the cameras (16 a -i, 
42) are time-stamped (page 2, paragraph 24). The Examiner is reading the labeling of 
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the tinning of each video frame (time-stamping) as including measurement data 
(measurement of time) as data that is stored for each frame. 

Re claim 14, Kanade discloses a video information storage medium (system 10 
includes video storage units 22) that stores picture information of a target object 
acquired from multiple perspectives, which stores first picture information in which a 
synchronization common frame count (each video frame is time stamped) has been 
sequentially added to video image data of each frame acquired by a plurality of cameras 
(16 a -i, 42), and second video image information in which a frame count corresponding 
with the video image data has been sequentially added to the camera parameters of 
each camera (16 a -i, 42) (page 2, paragraphs 24, 28; page 3, paragraph 30-page 4, 
paragraph 42; see claim 3). 

Re claim 15, Kanade further discloses that the camera parameters include 
camera attitude information of camera pan and tilt (viewing angle parameters) and 
zoom information (zoom control parameters) (page 4, paragraphs 45-46 and page 3, 
paragraphs 35-36). 

Re claim 16, Kanade discloses that the camera parameters include viewing 
angle parameters in x, y and z coordinates (page 3, paragraph 36). Thus, it can be 
seen that Kanada discloses that the camera parameters include two dimensional or 
three-dimensional position information of the camera. 
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Re claim 17, the system (10) disclosed by Kanade includes a camera parameter 
correction method, comprising the steps of: acquiring an image in a plurality of rotational 
positions by panning and/or tilting a camera (16 a -i, 42) (page 4, paragraphs 45-46); 
finding correspondence between the focal position of a camera (16 a -i, 42) and the 
center position of the axis of rotation from the image; acquiring the camera parameters 
(viewing angle parameters and zoom control parameters) of the camera; and correcting 
the camera parameters on the basis of the correspondence (page 2, paragraph 27-page 
4, paragraph 42) (image generators 20 are controlled to keep the point of interest the 
same size in all of the images captured by the cameras and are also controlled to 
automatically track and detect moving objects). 

Re claim 18, Kanade discloses a wide-range motion capture system (10) that 
acquires video information of a three-dimensional target object and reproduces three- 
dimensional movement of the target object, wherein the three dimensional movement of 
the target object is followed by changing, for a plurality of cameras (16 a -i, 42), camera 
parameters (viewing angle parameters and zoom control parameters) that include at 
least any one of the pan, tilt, and zoom of each camera (16 a -i, 42) (page 2, paragraph 
24, page, 3, paragraphs 35-36 and page 4, paragraphs 45-46), wherein video image 
data of a moving image is synchronized for each frame of the plurality of cameras (1 6 a . 
i, 42), camera parameters for each frame of each of the cameras, and association 
information (time stamps of image frames) that mutually associates the video image 
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data of the moving image with the camera parameters for each frame are acquired, and 
video image data of the moving image of the plurality of cameras (16 a -i, 42) is calibrated 
for each frame by using camera parameters (zoom control parameters and viewing 
angle parameters) that are associated with the association information, and information 
for analyzing the three-dimensional movement and attitude at each point in time of the 
target object is continuously obtained (page 2, paragraph 24— page 4, paragraph 43). 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 9-13 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kanade et al. US 2003/0076413. 

Re claim 9, Kanade discloses a video information storage medium (system 10 
includes video storage units 22) that executes system control commands to store 
picture information of a target object acquired from multiple perspectives. The system 
stores first picture information in which a synchronization common frame count (each 
video frame is time stamped) has been sequentially added to video image data of each 



Application/Control Number: 10/540,526 Page 10 

Art Unit: 2622 

frame acquired by a plurality of cameras (16 a -i, 42), and stores second video image 
information in which a frame count corresponding with the video image data has been 
sequentially added to the camera parameters of each camera (16 a -i, 42) (page 2, 
paragraphs 24, 28; page 3, paragraph 30-page 4, paragraph 42). However, although 
the Kanade reference discloses all of the above limitations and also discloses adding 
frame counts (time stamps) to video image data, it fails to specifically state that the 
system includes first and second program encoders for adding frame counts to the 
video image data. The Examiner takes Official Notice that it is well known in the art to 
utilize encoders to add additional information to video image data. Therefore, it would 
have been obvious for one skilled in the art to have been motivated to utilize encoders 
to add frame counts to the video image data disclosed by Kanade. Doing so would 
provide a means for effectively appending the frame count information to video image 
data in order to identify the video image data when performing image processing 
techniques. 

Re claims 10-11, Kanade further discloses that each frame of the video image 
data is stored in accordance with a frame count (video frames are time-stamped) (page 
2, paragraphs 24 and 27). The Examiner is reading the labeling of the timing of each 
video frame (time-stamping) as adding a frame count to video image data. 

Re claim 12, Kanade further discloses that the camera parameters include 
camera attitude information of camera pan and tilt (viewing angle parameters) and 
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zoom information (zoom control parameters) (page 4, paragraphs 45-46 and page 3, 
paragraphs 35-36). 

Re claim 13, Kanade discloses that the camera parameters include viewing 
angle parameters in x, y and z coordinates (page 3, paragraph 36). Thus, it can be 
seen that Kanada discloses that the camera parameters include two dimensional or 
three-dimensional position information of the camera. 

Conclusion 

The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Kanade et al. (US 7,106,361) discloses a system and method for manipulating 
the point of interest in a sequence of images. The information regarding a multiple 
camera system for tracking an object and generating video image data is relevant 
material. 

Kanade et al. (US 7,027,083) discloses a system and method for tracking a 
moving fixation point within a dynamic scene. The information regarding a multiple 
camera system for tracking an object and generating video image data is relevant 
material. 
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Kanade et al. (US 7,102,666) discloses a system and method for stabilizing 
rotational images. The information regarding a multiple camera system for tracking an 
object and generating video image data is relevant material. 

Contacts 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Kelly L. Jerabek whose telephone number is (571) 272- 
7312. The examiner can normally be reached on Monday - Friday (8:00 AM - 5:00 PM). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Lin Ye can be reached at (571) 272-7372. The fax phone number for 
submitting all Official communications is (571) 273-7300. The fax phone number for 
submitting informal communications such as drafts, proposed amendments, etc., may 
be faxed directly to the Examiner at (571) 273-7312. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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